WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 7 

G10L 9/06, G06F 9/00 



A3 



(11) International Publication Number: 
(43) International Publication Date: 



WO 00/20962 

13 April 2000 (13.04.00) 



(21) International Application Number: PCT/US 99/22927 

(22) International Filing Date: 1 October 1999 (01.10.99) 



(30) Priority Data: 

60/102,957 
60/117,595 



2 October 1 998 (02. 1 0.98) US 
27 January 1999 (27.01.99) US 



(71) Applicant (for all designated States except US): INTER- 

NATIONAL BUSINESS MACHINES CORPORATION 
[US/US]; Old Orchard Road, Armonk, NY 10504 (US). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): COFFMAN, Daniel 
[US/US]; Barrett Circle, Carmel, NY 10512 (US). COM- 
ERFORD, Liam, D. [US/US]; 54 Valley Road, Carmel, 
NY 10512 (US). DEGENNARO, Steven, V. [US/US]; 
38 Coulter Avenue, Carmel, NY 10512 (US). EPSTEIN, 
Edward, A. [US/US]; 219 Canopus Hollow Road, Putnam 
Valley, NY 10579 (US). GOPALAKRISHNAN, Ponani 
[IN/US]; 3073 Radcliff Drive, Yorktown Heights, NY 
10598 (US). MAES, Stephane, H. [BE/US]; 1 Wintergreen 
Hill Road, Danbury, CT 06811 (US). NAHAMOO, David 
[IR/US]; 12 Elmwood Road, White Plains, NY 10605 (US). 



(74) Agent: OTTERSTEDT, Paul, J.; International Business Ma- 
chines Corporation, Yorktown IP Law Department, TJ. 
Watson Research Center, Route 134 and Kitchawan Road, 
Yorktown Heights, NY 10598 (US). 



(81) Designated States: CA, CN, IL, IN, JP, KR, US, European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, 
IE, IT, LU, MC, NL, PT, SE). 



Published 

With international search report. 

(88) Date of publication of the international search report: 

13 July 2000(13.07.00) 



(54) Title: CONVERSATIONAL COMPUTING VIA CONVERSATIONAL VIRTUAL MACHINE 



Contexts, FSG f 
vocabularies, 
LM f symbolic 
maps, 
personality, etc., 



Conversational 
sub-systems 
(engines) 




Conversationally aware applications 



«*| Conversationally API-CVM API 

* — 



Conventional 
Apps 



(57) Abstract 

A conversational 
computing system that provides 
a universal coordinated 
multi-modal conversational 
user interface (CUI) (10) across 
a plurality of conversationally 
aware applications (11) (i.e., 
applications that "speak" 
conversational protocols) and 
conventional applications (12). 
The conversationally aware 
applications (11) communicate 
with a conversational kernel 
(14) via conversational 
application APIs (13). The 
conversational kernel (14) 
controls the dialog across 
applications and devices (local 
and networked) on the basis of 
their registered conversational 
capabilities and requirements 
and provides a unified 
conversational user interface 
and conversational services and 
behaviors. The conversational 
computing system may be 
built on top of a conventional 

operating system and APIs (15) and conventional device hardware (16). The conversational kernel (14) handles all I/O processing and 
controls conversational engines (18). The conversational kernel (14) converts voice requests into queries and converts outputs and results 
into spoken messages using conversational engines (18) and conversational arguments (17). The conversational application API (13) 
conveys all the information for the conversational kernel (14) to transform queries into application calls and conversely convert output 
into speech, appropriately sorted before being provided to the user. 



Conversational Virtual Machine 



I 



Conventional OS and API 



Hardware 




ID: <WO_0020962A3_I_> 



FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


sz 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


- US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


UZ 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


ZW 


Zimbabwe 


CI 


Cdte d'Tvoh-e 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


PT 


Portugal 






cu 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






cz 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


U 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







BNSDOCID: <WO 0020962A3_L> 



INTERNATIONAL SEARCH REPORT 



I nit. national application No. 
PCT/US99/22927 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(7) :G10L 9/06; C06F 9/00 

US CL : 345/326; 709/328 
According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 345/326; 709/328 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
WEST; EAST; ACM; MSDN 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



A,P 

A 

A 

A 

A 



US 5,884,266 A (DVORAK) 16 MARCH 1999, ALL 

US 5,794,205 A (WALTERS ET AL) 11 AUGUST 1998, ALL 

US 5,283,888 A (DAO ET AL) 01 FEBRUARY 1994, ALL 

US 5,133,004 A (HEILEMAN JR. ET AL) 21 JULY 1992, ALL 

US 5,255,305 A (SATTAR) 19 OCTOBER 1993, ALL 



1, 5-8 
1, 5-8 
1 

1, 5-8, 16 



| | Further documents are listed in the continuation of Box C. | | See patent family annex. 



" Special categories of cited document*" 

"A" document de lining the general state of the an which is not considered 

to be of particular relevance 

"E" earlier document published on or after the international filing date 

"L" document which may throw doubts on priority claim (s) or which is 

cited to establish the publication date of another citation or other 
special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or other 

means 

•p* document published prior to the international filing date but later than 
the priority date claimed 



later document published after the imernatiurml filing date or prmtity 
date and not in conflict with the application but cited 10 understand 
the principle or theory underlying the invention 

document of particular relevance, the claimed invention cannot be 
considered novel or cannot be considered 10 involve an inventive step 
when the document is taken alone 

document of particular relevance: the claimed invention cannot be 
considered to involve an inventive step when the document ts 
combined with one or more other such documents, such combination 
being obvious 10 a person skilled in the an 

document- member of the same patent family 



Date of the actual completion of the international search 



16 MARCH 2000 



Date of mailing of the international search report 



18APR2000 



Name and mailing address of the ISA/ US 
Commissioner of Patents and Trademarks 
Box PCT 

Washington. D.C. 20231 
Facsimile No. (703) 30S-3230 



Authorized officer 

ALVIN OBERLEY 



Telephone No. (703) 30: 




Form PCT/ISA/210 (second sheet) (July 1998) 



<WO 0O20962A3_L> 



V 



